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Preface 

This article describes two complementary approaches to enumeration, the positive and the negative, 
each with its advantages and disadvantages. Both approaches are amenable to automation, and 
when applied to the currently active subarea, initiated in 2003 by Sergi Elizalde and Marc Noy[EN], 
of consecutive pattern-avoidance in permutations, were successfully pursued by the first two authors 
Andrew Baxter [B] and Brian Nakamura[N]. This article summarizes their research and in the case of 
[N] presents an umbral viewpoint to the same approach. The main purpose of this article is to briefly 
explain the Maple packages, SERGI and ELIZALDE, developed by AB-DZ and BN-DZ respectively, 
implementing the algorithms that enable the computer to "do research" by deriving, all by itself, 
functional equations for the generating functions that enable polynomial-time enumeration for any 
set of patterns. In the case of ELIZALDE (the "negative" approach), these functional equations 
can be sometimes (automatically!) simplified, and imply "explicit" formulas, that previously were 
derived by humans using ad-hoc methods. We also get lots of new "explicit" results, beyond the 
scope of humans, but we have to admit that we still need humans to handle "infinite families" of 
patterns, but this too, no doubt, will soon be automatable, and we leave this as a challenge to the 
(human and/or computer) reader. 

Consecutive Pattern Avoidance 

Inspired by the very active research in pattern-avoidance, pioneered by Herb Wilf, Rodica Simion, 
Frank Schmidt, Richard Stanley, Don Knuth and others, Sergi Elizalde, in his PhD thesis (written 
under the direction of Richard Stanley) introduced the study of permutations avoiding consecutive 
patterns. 

Recall that an n-permutation is a sequence of integers vr = tti . . . 7r„ of length n where each integer 
in {1, . . . , n} appears exactly once. It is well-known and very easy to see (today!) that the number 
of n-permutations is n! := HlLi ^ 

The reduction of a list of different (integer or real) numbers (or members of any totally ordered set) 
[zi,Z2, . . . ,ifc]i to be denoted by R{[ii,i2, ■ ■ ■ ,ik]), is the permutation of {1,2, . . . ,k} that preserves 
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the relative rankings of the entries. In other words, pi < pj iff gj < qj. For example the reduction 
of [4, 2, 7, 5] is [2, 1, 4, 3] and the reduction of [tt, e, 7, cf)] is [4, 3, 1, 2]. 

Fixing a pattern p = [pi, . . . ,Pk], a permutation tt = [tti, . . . ,7r„] avoids the consecutive pattern p 
if for alH, 1 < z < n — A; + 1, the reduction of the list [tTj, tTj+i , . . . , 7rj_|_fe_i] is not p. More generally 
a permutation tt avoids a set of patterns V if it avoids each and every pattern p eV. 

The central problem is to answer the question: "Given a pattern or a set of patterns, find a 
'formula', or at least an efficient algorithm (in the sense of Wilf[W]), that inputs a positive integer 
n and outputs the number of permutations of length n that avoid that pattern (or set of patterns)" . 

Human Research 

After the pioneering work of Elizalde and Noy [EN] , quite a few people contributed significantly, 
including Anders Claesson, Toufik Mansour, Sergey Kitacv, Anthony Mendes, Jeff Remmel, and 
more recently, Vladimir Dotsenko, Anton Khoroshkin and Boris Shapiro. Also recently we witnessed 
the beautiful resolution of the Warlimont conjecture by Richard Ehrenborg, Sergey Kitaev, and 
Peter Perry [EKP]. The latter paper also contains extensive references. 

Recommended Reading 

While the present article tries to be self-contained, the readers would get more out of it if they 
are familiar with [Zl]. Other applications of the umbral transfer matrix method were given in 
[EZ][Z2][Z3][Z4]. 

The Positive Approach vs. the The Negative Approach 

We will present two complementary approaches to the enumeration of consecutive- Wilf classes, 
both using the Umbral transfer matrix method. The positive approach works better when you 
have many patterns, and the negative approach works better when there are only a few, and works 
best when there is only one pattern to avoid. 

Outline of the Positive Approach 

Instead of dealing with avoidance (the number of permutations that have zero occurrences of 
the given pattern(s)) we will deal with the more general problem of enumerating the number of 
permutations that have specified numbers of occurrences of any pattern of length k. 

Fix a positive integer k, and let {tp : p € S'^} be fc! commuting indeterminates (alias variables). 
Define the weight of an n-permutation vr = [vri, . . . , 7r„], to be denoted by w{-k), by: 

n-fe+l 

U;([7ri,...,7r„]) := JJ tR([7ri,7ri+i,...,7ri+fc_i]) • 
i=l 

For example, with k = 3, 

w{[2, 5, 1, 4, 6, 3]) := tfl([2,5,l])*fl([5,l,4])ifl([l,4,6])*R([4,6,3]) = *23li312*123i231 = il23*231*312 ■ 
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We are interested in an efficient algorithm for computing the sequence of polynomials in k\ variables 

Pn{tl...k,---,tk...l) ■■= w{Tr) , 

or equivalently, as many terms as desired in the formal power series 

oo 

Fki{tp,peSk};z) = Y,Pnz'' . 

n=0 

Note that once we have computed the P„ (or Fk), we can answer any question about pattern 
avoidance by specializing the fs. For example to get the number of n-permutations avoiding the 
single pattern p, of length k, first compute P„, and then plug-in tp = and all the other t's to be 1. 

If you want the number of n-permutations avoiding the set of patterns V (all of the same length k), 
set tp = for all p G "P and the other t's to be 1. As we shall soon see, we will generate functional 
equations for F^, featuring the {tp} and of course it would be much more efficient to specialize the 
ip's to the numerical values already in the functional equations, rather than crank-out the much 
more complicated Pn{{tp}ys and then do the plugging-in. 

First let's recall one of the many proofs that the number of n-permutations, let's denote it by a(n), 
satisfies the recurrence 

a(n + 1) = (n -|- l)a(n) 

Given a typical member of S'„, let's call it tt = tti . . . tt^, it can be continued in n + 1 ways, by 
deciding on 7r„_|_i. If TTn+i = i, then we have to "make room" for the new entry by incrementing by 
1 all entries > i, and then append i. This gives a bijection between 5„ x [1, n -|- 1] and Sn+i and 
taking cardinalities yields the recurrence. Of course a(0) = 1, and "solving" this recurrence yields 
a(n) = n!. Of course this solving is "cheating", since n! is just shorthand for the solution of this 
recurrence subject to the initial condition a(0) = 1, but from now on it is considered "closed form" 
(just by convention!). 

When we do weighted counting with respect to the weight w with a given pattern-length k, we have 
to keep track of the last A; — 1 entries of tt: 

and when we append iTn+i = i, the new permutation (let a' = a ii a < i and a' = a + 1 ii a > i) 

■ ■ ■ '^n-k+2 ■ ■ ■ ■^n^ ) 

has "gained" a factor of tn^T^' to its weight. 

This calls for the finite-state method, alas, the "alphabet" is indefinitely large, so we need the 
umbral transfer-matrix method. 
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We introduce k — 1 "catalytic" variables xi,X2, - ■ ■ ,Xk-i, as well as a variable z to keep track of 

the size of the permutation, and {k — 1)! "linear" state variables A[q] for each q € Sk-i, to tell us 
the state that the permutation is in. Define the generalized weight w'{Tr) of a permutation n & Sn 
to be: 

w'{7r) := w{7r)x{' x{^ . . . xfj/ z'^Alq] , 

where [ji, . . . ,jk-i], (1 < ii < i2 < • • • < jk-i < n) is the sorted list of the last k — 1 entries of tt, 
and q is the reduction of its last k — 1 entries. 

For example, with A; = 3: 

W'{[4, 7, 1, 6, 3, 5, 8, 2]) = t23lt312tl32t312*123i23ia;?xiz^yl[21] = h23tl32t23l4l2xlxlz'^ A[21] . 

Let's illustrate the method with k = 3. There are two states: [1, 2], [2, 1] corresponding to the cases 
where the two last entries are jij2 or j2ji respectively (we always assume ji < ^2) • 

Suppose we are in state [1,2], so our permutation looks like 

7r= [...,ji,i2] , 

and w'{7r) = w{7r)x-[^ x^2 ^[^^ 2]. We want to append i (1 < i < n + 1) to the end. There are three 
cases. 

Case 1: 1 < i < ii 

The new permutation, let's call it a, looks like 

a = [...ji + 1^2 + 1,1] ■ 
Its state is [2, 1] and w'{a) = w{Tr)t23ix\xf~^^z''+^A[2, 1]. 
Case 2: ji + 1 < i < ja • 
The new permutation, let's call it a, looks like 

= [••• jl,j2 + ■ 

Its state is also [2, 1] and w'{a) = iu(7r)ii32xixf +^2;"+M[2, 1]. 

Case 3: j2 + 1 <i <n + l 

The new permutation, let's call it a, looks like 

(T=[...jl,j2,i] ■ 

Its state is now [1,2] and w'{a) = w{Tr)ti23xi^xiz"-+^A[l,2]. 
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It follows that any individual permutation of size n, and state [1,2], gives rise to n + 1 children, 
and regarding weight, we have the "umbral evolution" (here W is the fixed part of the weight, that 
does not change): 
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+Whs2zA[2, 1] I J2 ^1^?^' 



+Wh23zA[l,2] I J2 ) z' 

\j=i2+i / 

Taking out whatever we can out of the ^-signs, we have: 

/ ji 



Wx{^x^z''A[l,2] Wt23izA[2,l] 

\i=l / 

+Wh32zA[2, 1] I xl| xf +^2 



n+1 



+Wh23zA[l,2] I ^ I x{'z' 

. i=i2+l 



Now summing up the geometrical series, using the ancient formula: 

- 1-Z ' 



we get 



WxYxfz-^A\l,2] ^ m23i^^[2,l] (- I x^o'+'z" 

/™J2 + 1 _ ^n+2\ 
+ mi23-^^[l, 2] ^ j Xf . 



This is the same as: 



X1X2 _^ X2 \, 

(^J1+1™J2+1 _ ™i2 + l„j2 + l\ 
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This is what was cahed in [Zl], and its many sequels, a "pre-umbra" . The above evolution can be 
expressed for a general monomial M{xi,X2, z) as: 



XiX2M{l,X2,z) - XiX2M{xi,X2,z) 
1 — Xi 



/irr, f XiX2M{xi,X2,z) - XiX2M{l,XiX2,z)\ 

+hs2zA[2, 1] ^ J 

' X2M{1, XlX2,z) — X2M(1, XI,X2Z) 



+il23^^[l,2] , ^ 

' 1-X2 

But, by linearity, this means that the coefficient of ^[1,2] (the weight-enumerator of all permuta- 
tions of state [1,2]) obeys the evolution equation: 



fi2{xi,X2,z)A[\,2\ t2zizA[2,l\ I — — 

\ L X\ 



X2h2{xi,X2,z) 



+h32zA[2 1] ( ^i^2/i2(a;i,X2,2:) - Xia;2/i2(l,a;iX2,^:) 
' V l-xi 

+ti23zA\l 21 ( ^^-^i^^^'^i^^,^) - a;i/i2(l,a;i,a;2^) \ 
^^^^ 'V 1-2^2 J ' 

Now we have to do it all over for a permutation in state [2, 1]. Suppose we are in state [2, 1], so our 
permutation looks like 

TT = [. ..,i2,ii] , 

and 'w'{tt) = w{'k)x-'-^ x-2 z'^ A\^, 1]. We want to append i {\ < i < n + \) to the end. There are three 
cases. 

Case 1: 1 < i < ji 

The new permutation, let's call it cr, looks like 

o- = [. . .^2 + l,Ji + • 
Its state is [2, 1] and w'{a) = w{Tr)t32ix\xi^^'^z''+'^A[2, 1]. 
Case 2: ji + 1 < i < j2 . 
The new permutation, let's call it a, looks like 

£7 = [. . .J2 + l,Jl,i] • 

Its State is also [1,2] and w'{a) = w{7T)t3i2x{^ xiz"-+'^A[l,2]. 
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Case 3: j2 + l <i <n + l . 

The new permutation, let's call it a, looks like 



o" = [■■■J2, ■ 

Its state is now [1,2] and w'{a) = w{n)t2i3x{^xiz'^+^A[l,2]. 

It follows that any individual permutation of size n, and state [2, 1], gives rise to n + 1 children, 
and regarding weight, we have the "umbral evolution" (here W is the fixed part of the weight, that 
does not change): 

/ \ 



+1 

= 1 / 



Wx{'x{^z'^A%l] -^WU2izA%l\ \^x\x{^ 

\i=ji+l 

+Wt2i3zA[l,2] ( ^" • 

Taking out whatever we can out of the ^-signs, we have: 

VFa;f ^"A[2,l] ^ Wt32izA[2,l] (^X^^ij 4'^^^" 

+Wtsi2zA[l,2] I Y xUxi'z^ 

\i=Ji+l / 



n+1 



+m2i3^^[i,2] Yl 



xl x{^z"' 



Now summing up the geometrical series, using the ancient formula: 

b 



^ l-Z 



we get 



W^xf 4^z"y4[2,l] ^ WU2izA[2,l] [ ^i^i^ I 41+1^" 



1 — Xi 

+Wt3i2zA[l,2] ( ) xf 
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/J2+1_ n+2\ 
+m213^A[l, 2] I j X{^Z- 



This is the same as: 



_^ X2 j 



+m3l2^^[l,2] 



"f'l ■''2 -^-l ■''2 1 



+ m213^^[l,2] ^^-^ 1 



1 — X2 

1 - a;2 

The above evolution can be expressed for a general monomial M{xi,X2, z) as: 

n^t \Aln-l^^-^ f XiX2M{x2,l, z) - xiX2M{xiX2,l, z)\ 
M{xi,X2,z)A[2,l\ -^t32izA[2,l\ I ^ 1 - xi ^ ) 

,+ AU f X2M{XIX2,1,Z) - X2M{XI,X2,Z)\ 

+t3i2ZA[L, 2] 

V 1-2^2 / 

/in f X2M{xi,X2,z) - xlM{xi,l,X2z)\ 

V 1-2^2 / 

But, by linearity, this means that the coefficient of A[2, 1] (the weight-enumerator of all permuta- 
tions of state [2, 1]) obeys the evolution equation: 

f I ^/l^o1l^+ .rr, 11 /a:^ia;2/2i(a;2, 1,2;) -2:1X2/21(2:1X2, 1,2:) \ 
/2i(xi,X2,2;)^[2, 1] ^ t32i2;A[2, 1] I \-xx ] 

,^. At-, f X2f2l{xiX2,l,z) - X2f2l{xi,X2,zy 
+tsi2ZA[i., l\ 

+t2izzA[l,2] 
Combining we have the "evolution" : 



1 - X2 

X2f2l{xi,X2,z) - x|/2l(xi, 1,X22:) 
1 - X2 



/l2(xi,X2,2;)^[l,2] +/2l(xi,X2,2;)^[2,l] ^ 

t23i2^[2 11 ( ^^^2/12(1, 3^2, 2) - 3^1X2/12 (a;i,X2, 
' V 1 - Xi 

+ti32zA[2 1] 1^ ^1^2/12 (a;i,X2, 2:) - xiX2/i2(l, a:iX2, 2) ^ 

-|-tl232^[l 2] ^ ^2/12(1, 2:1X2,2) - x|/i2(l,Xi,X22) 



1 - X2 



^ro 11 /^a;iX2/2l(x2,l,2) -XiX2/2l(xiX2,l,2)\ 

+ts2izA[2, 1] ^—^^ J 



+t213Z 



+t zA\\ 21 { ^2/21(3^13^2,1,^:) - X2h\{Xx,X2,z) 

' V 1 - X2 

+t ZAW 21 { ^2/21(3^1,3^2,^) - Xlf2lixi, 1,X2Z) 

' V 1-X2 

Now the "evolved" (new) fi2ixi,X2, z) and f2iixi,X2, z) are the eoeffieients of ^[1,2] and A[2, 1] 
respectively, and since the initial weight of both of them is we have the estabhshed the 

following system of functional equations: 

fl2ixi,X2,z) = Xixlz^ 

X2fl2{i,XlX2,z) - X2fl2{i,Xl,X2z) 
I— X2 

X2f2l{x\X2,l,z) - X2f2l{xi,X2,z) 
1 - X2 

X2f2l{xi,X2,z) - x\f2\{x\,\,X2z) 
1- X2 

f2l{xi,X2,z) = Xixlz^ 

XlX2fl20-,X2,z) - XiX2fl2{xl,X2,z] 
1 — Xl 

XlX2fl2{xi,X2,z) - XiX2fl20-,XlX2,z) 
1 — Xl 

XlX2f2li-l-2, 1: z) - .ri.r2i2i(-i'iJ'2. 1- z) 

1 — Xl 



and 



+^231 2 
+^132-2; 
+^321 2: 



Let the computer do it! 

All the above was only done for pedagogical reasons. The computer can do it all automatically, 
much faster and more reliably. Now if we want to find functional equations for the number of 
permutations avoiding a given set of consecutive patterns V, all we have to do is plug-in tp = for 
p ^ V and tp = 1 for p ^ V. This gives a polynomial-time algorithm for computing any desired 
number of terms. This is all done automatically in the Maple package SERGI. See the webpage of 
this article for lots of sample input and output. 

Above we assumed that the members of the set P are all of the same length, k. Of course more 
general scenarios can be reduced to this case, where k would be the largest length that shows up 
in P. Note that with this approach we end up with a set of (A; — 1)! functional equations in the 
(fc — 1)! "functions" (or rather formal power series) fp. 

The Negative Approach 

Suppose that we want to quickly compute the first 100 terms (or whatever) of the sequence enu- 
merating n-permutations avoiding the pattern [1, 2, . . . , 20]. As we have already noted, using the 
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"positive" approach, we have to set-up a system of functional equations with 19! equations and 
19! unknowns. While the algorithm is still polynomial in n (and would give a "Wilfian" answer), 
it is not very practical! (This is yet another illustration why the ruling paradigm in theoretical 
computer science, of equating "polynomial time" with "fast" is (sometimes) absurd). 

This is analogous to computing words in a finite alphabet, say of a letters, avoiding a given word 
(or words) as factors (consecutive subwords). If the word-to-avoid has length k, then the naive 
transfer-matrix method would require setting up a system of a!'~^ equations and a^~^ unknowns. 
The elegant and powerful G Gulden- Jackson method [GJ1][GJ2], beautifully exposited and extended 
in [NZ], and even further extended in [KY], enables one to do it by solving one equation in one 
unknown. We assume that the reader is familiar with it, and briefly describe the analog for the 
present problem, where the alphabet is "infinite" . This is also the approach pursued in the beautiful 
human-generated papers [DK] and [KS] . We repeat that the focus and novelty in the present work 
is in automating enumeration, and the current topic of consecutive pattern-avoidance is used as a 
case-study. 

First, some generalities! For ease of exposition, let's focus on a single pattern p (the case of several 
patterns is analogous, see [DK]). 

Using the inclusion-exclusion "negative" philosophy for counting, fix a pattern p. For any n- 
permutation, let Pattp{Tr) be the set of occurrences of the pattern p in tt. For example 

Patti23 (179234568) = {179, 234, 345, 456, 568} , 

Patt23i (179234568) = {792} , 
Patt3i2 (179234568) = {923} , 
Patti32 (179234568) = Pattzis (179234568) = Patt32i (179234568) = . 

Consider the much larger set of pairs 

{(7r,5)| 7r€5„ , S C Pattpiir)}, 

and define 

weightp{7r,S) := {t - 1)^'^^ , 
where \S\ is the number of elements of S. For example, 

weighti23 [179234568, {234, 568}] = {t - if , 

wei5/iti23 [179234568, {179}] = {t - 1)^ = (^ - 1) , 
w;ei5/iii23 [179234568, 0] = (t - 1)° = 1 . 



Fix a (consecutive) pattern p of length k, and consider the weight-enumerator of all n-permutations 
according to the weight 

y^^^^ . ^^occurrences of pattern p in n 
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let's call it P„(t). So: 

p„(t) := ^ t^Patt,in)\ _ 

Now we need the crucial, extremely deep, fact: 

t = {t-l) + l , 

and its corollary (for any finite set S): 

ii^i = at - 1) + 1)1^1 = n((* - 1) + 1) = E - 1)'^' ■ 

seS TC5 

Putting this into the definition of Pn{t), we get: 

7reS„ TTeS„TCPaUp{n) 

This is the weight-enumerator (according to a different weight, namely (t — 1)'"^') of a much larger 
set, namely the set of pairs, {'k,T), where T is a subset of Pattp{-K). Surprisingly, this is much 
easier to handle! 

Consider a typical such "creature" (7r,T). There are two cases 

Case I: The last entry of tt, 7r„ does not belong to any of the members of T, in which case chopping 
it produces a shorter such creature, in the set {1,2,..., n}\{7r„}, and reducing it to {1, . . . , n — 1} 
yields a typical member of size n — 1. Since there are n choices for 7r„, the weight-enumerator of 
creatures of this type (where the last entry does not belong to any member of T) is nPn-i{t). 

Case II: Let's order the members of T by their first (or last) index: 

[si,S2,...,Sp] , 

where the last entry of tt, 7r„, belongs to Sp. If Sp and Sp_i are disjoint, the ending cluster is 
simply [sp\. Otherwise Sp intersects Sp_i. If Sp_i and Sp-2 are disjoint, then the ending cluster is 
[sp_i, Sp\. More generally, the ending-cluster of the pair [vr, [si, . . . , Sp]] is the unique list [si, . . . ,Sp\ 
that has the property that Si intersects Si+i, Si+i intersects 5^+2) • • •> Sp-i intersects Sp, but Sj_i 
does not intersect Sj. It is possible that the ending-cluster of [7r,T] is the whole T. 

Let's give an example: with the pattern 123. The ending cluster of the pair: 

[157423689, [157, 236, 368, 689]] 

is [236, 368, 689] since 236 overlaps with 368 (in two entries) and 368 overlaps with 689 (also in two 
entries), while 157 is disjoint from 236. 

Now if you remove the ending cluster of T from T and remove the entries participating in the 
cluster from tt, you get a shorter creature [it' ,T'] where tt' is the permutation with all the entries 
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in the ending cluster removed, and T' is what remains of T after we removed that cluster. In the 
above example, we have 

[7r',r'] = [1574, [157]] . 

Suppose that the length of tt' is r. 

Let Cn{t) be the weight-enumerator, according to the weight (t — 1)'^', of canonical clusters of 
length n, i.e. those whose set of entries is {1, . . . ,n}. Then in Case II we have to choose a subset 
of {1, . . . , n} of cardinality r to be the [tt', T'\ and then choose a creature of size r and a cluster of 
size n — r. Combining Case I and Case II, we have , Po{t) = 1, and for n > 1: 



Pn{t) = nPn-l{t)+^('^]Pn-r{t)Cr{t) 



r=2 

Now it is time to consider the exponential generating function 



n=0 

We have 



n=l n=l n=0 \r=2 ^ ^ / 

- 1 + ^- E + E (e ^."-Mt)) 

n=l ^ ' ri=0 \r=2 ^ ' / 

= 1 + - E + E (E ^:^,P,^-At)CAf^ 

n=0 ■ n=0 \r=2 '' J 

= i + .f(.,o + e(e^^)." 

n=0 \r=2 ^ '' ' ) 



\n-r=0 ^ ' / \r=n 

= l + zF{z,t) + F{z,t)G{z,t) , 
where G{z,t) is the exponential generating function of C„(t): 

oo 

G{z,t) :=J2 

It follows that 



n! 

n=0 



F{z,t) = l + zF{z,t) + F{z,t)G{z,t) , 

leading to 

Fiz,t) ^ 



l-z-G{z,t) ' 

So if we would have a quick way to compute the sequence Cn{t), we would have a quick way to 
compute the first whatever coefficients (in z) of F{z,t) (i.e. as many Pn{t) as desired). 
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A Fast Way to compute C„(t) 

For the sake of pedagogy let the fixed pattern be 1324. Consider a typical cluster 

[13254768, [1325, 2547, 4768]] . 
If we remove the last atom of the cluster, we get the cluster 

[132547, [1325, 2547]] , 
of the set {1, 2, 3, 4, 5, 7}. Its canonical form, reduced to the set {1, 2, 3, 4, 5, 6}, is: 

[132546, [1325, 2546]] . 

Because of the "Markovian property" (chopping the last atom of the clusters and reducing yields 
a shorter cluster), wc can build-up such a cluster, and in order to know how to add another atom, 
all we need to know is the current last atom. If the pattern is of length k (in this example, 
A; = 4), we need only to keep track of the last k entries. Let the sorted list (from small to large) 
be < ... < ik, so the last atom of the cluster (with r atoms) is Sr = [ip^^, . . . ,ip^], where 
1 < ii < 12 <■■■< ik < n is some increasing sequence of k integers between 1 and n. We introduce 
k catalytic variables Xi, . . . ,Xk, and define 



Going back to the 1324 example, if we currently have a cluster with r atoms, whose last atom is 
[^1, ^3, ^2, m], how can we add another atom? Let's call it [ji,i3,i2, J4] The new atom can overlap 
with the former one either in its last two entries, having: 

ji = «2 is = 14 , 

but because of the "reduction" (making room for the new entries) it is really 

ji =i2 is = «4 + 1 , 

(and j2 and J4 can be what they wish as long as 12 < j2 < H + ^ < ji < n). The other possibility 
is that they only overlap at the last entry: 



Weight{[s\, . . . 



) Sr-li [ipi ) • • • ) ^pfc]]) •— Z (t 1) ' ' ' X 



'k 



Jl = 



(and j2 ) js , ji can be what they wish, provided that 14 < j2 < Ja < j4 < n) . 



Hence we have the "umbral-evolution" : 



z"(t- 1) 



1 2 3 4 



.n- 






1 <il =*2 < J2 <i3 =*4 + 1< J4 <«■ 
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1 <ji =44 < J2 <j3 <jt <n 

These two iterated geometrical sums can be summed exactly, and from this "pre-umbra" the com- 
puter can deduce (automatically!) the umbral operator, yielding a functional equation for the 
ordinary generating function 

oo 

C{t 

1 ^1 1 • • • 1 ^k)^ ) 

n=0 

of the form 

C{t,z;xi,..., Xk) = {t- \)z^xxxl . . . x| + , . . . , Xfe; t, z)C(t, z;M^,...,M^) , 

a 

where {a} is a finite index set, Mf , . . . , are specific monomials in xi, . . . ,Xk, z, derived by the 
algorithm, and Ra are certain rational functions of their arguments, also derived by the algorithm. 

Once again, the novelty here is that everything (except for the initial Maple programming) is done 
automatically by the computer. It is the computer doing combinatorial research all on its own! 

Post-Processing the Functional Equation 

At the end of the day we are only interested in C{t, z;l,... , 1). Alas, plugging-in xi = 1,X2 = 
1, . . . ,Xk = 1 would give lots of 0/0. Taking the limits, and using L'Hopital, is an option, but then 
we get a differential equation that would introduce differentiations with respect to the catalytic 
variables, and we would not gain anything. 

But it so happens, in many cases, that the functional operator preserves some of the exponents of 
the x^s. For example for the pattern 321 the last three entries are always [3,2, 1], and one can do 
a change of dependent variable: 

C{t,z;xi,...,X3) =xixlxlg{z;t) , 

and now plugging-in xi = 1,2:2 = l,a:3 = 1 is harmless, and one gets a much simplified functional 
equation with no catalytic variables, that turns out to be (according to S.B. Ekhad) the simple 
algebraic equation 

giz,t) = -it - l)z^ -{t- l)iz + z^)giz,t) , 

that in this case can be solved in closed- form (reproducing a result that goes back to [EN]). Other 
times (like the pattern 231), we only get rid of some of the catalytic variables. Putting 

C{t,z;xi,...,X3) = Xixlg{x3,z;t) , 

(and then plugging-in Xi = 1,X2 = 1) gives a much simplified functional equation, and now taking 
the limit X3 — > 1 and using L'Hopital (that Maple does all by itself) one gets a pure differential 
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equation for g(l,z;t), in z, that sometimes can be even solved in closed form (automatically by 
Maple). But from the point of view of efficient enumeration, it is just as well to leave it at that. 

Any pattern p is trivially equivalent to (up to) three other patterns (its reverse, its complement, 
and the reverse-of-the-complement, some of which may coincide). It turns out that out of these (up 
to) four options, there is one that is easiest to handle, and the computer finds this one, by finding 
which ones gives the simplest functional (or if in luck differential or algebraic) equation, and goes 
on to only handle this representative. 

The Maple package ELIZALDE 

All of this is implemented in the Maple package ELIZALDE, that automatically produces theorems 
and proofs. Lots of sample output (including computer-generated theorems and proofs) can be 
found in the webpage of this article: 

http : / /www . math . rutgers . edu/'zeilberg/mamarim/mamarimhtinl/auto . html 

In particular, to see all theorems and proofs for patterns of lengths 3 through 5 go to (respectively): 
http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oEP3_200 , 
http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oEP4_60 , 
http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oEP5_40 . 

If the proofs bore you, and by now you believe Shalosh B. Ekhad, and you only want to see the 
statements of the theorems, for lengths 3 through 6 go to (respectively): 

http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oET3_200 , 

http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oET4_60 , 

http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oET5_40 . 

http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oET6J0 . 

Humans, with their short attention spans, would probably soon get tired of even the statements of 
most of the theorems of this last file (for patterns of length 6). 

In addition to "symbol crunching" this package docs quite a lot of "number crunching" (of course 
using the former). To see the "hit parade" , ranked by size, together with the conjectured asymptotic 
growth for single consecutive-pattern avoidance of lengths between 3 and 6, see, respectively, the 
output files: 

http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oE3_200 , 
http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oE4_60 , 
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http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oE5_40 , 
http://www.math.rutgers.edu/ zeilberg/tokhniot/sergi/oE6_30 
Enjoy! 
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